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40 Create a Panorama - Microsoft Internet Explorer [Z 
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Upload the images you want to use for your panorama 
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40 Panorama result - Microsoft Internet Explorer [. 
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( START ) 



RECEIVE IMAGES OVER NETWORK 






DETERMINE RELATIVE POSITIONS 




r 204 


CORRECT PERSPECTIVE DISTORTION 






COMPUTE FOCAL LENGTH AND 
ANGLE FOR EACH IMAGE 




r 208 


MAP IMAGES TO CYLINDER 
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BLEND IMAGES 
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CREATE EMPTY "POSITIONED LIST' STRUCTURE FOR 
STORING IMAGES WHOSE RELATIVE POSITION IS KNOWN 



702 



( DONE 



NO 



CHECK IF 
JTHERE IS AN UNPOSITIONED 
IMAGE ? 

"YES 

'check if 
positioned list is empty_ 

9 

NO 



704 



706 



I — (FROM 774 (FIG 7B)) 



708 



ADD UNPOSTIONED 
IMAGE TO 
POSITIONED LIST 



CREATE EMPTY "OVERLAP LIST' FOR STORING IMAGES-IN 
POSITIONED LIST THAT OVERLAP THE UNPOSITIONED IMAGE 



SET: 

BESTjCONFIDENCE = 0 
BESTjCONFIDENCEJMAGE = NO_MATCH 
CURRENTJMAGE = FIRST IMAGE IN POSITIONED LIST 



I 



712 



DETERMINE OFFSET OF UNPOSITIONED IMAGE 
RELATIVE TO CURRENT IMAGE AND A 
CONFIDENCE VALUE FOR THE OFFSET 



CHECK 

JF CONFIDENCE VALUE > A THRESHOLD. 
VALUE. 

"YES 



716 
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ADD CURRENT IMAGE, THE OFFSET, AND THE 
CONFIDENCE VALUE TO THE OVERLAP LIST 



CHECK 

IF CONFIDENCE VALUE > BEST 
CONFIDENCE ? 

YES 
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SET: 

BESTCONFIDENCE = CONFIDENCE VALUE 
BESTCONFIDENCEJMAGE = CURRENTJMAGE 



CHECK 

IF CURRENT IMAGE IS LAST IN 
.POSITIONED LIST 1_ 

"YES 
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SET REFERENCE IMAGE TO 
FIRST IMAGE IN OVERLAP LIST 
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SET CURRENT 
IMAGE TO NEXT 
IMAGE IN 
POSITIONED 
LIST 
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(FROM 728 (FIG 7A)) 



750 



CHECK IF 
REFERENCE IMAGE IS LAST IMAGE 
IN OVERLAP LIST ? 



YES 



NO 
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SET CURRENT IMAGE = NEXT IMAGE AFTER 
REFERENCE IMAGE IN OVERLAP LIST 



YES 
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CHECK IF 
"ADJACENT LISTS INDICATE THAT 
CURRENT IMAGE IS CONNECTED TO 
REFERENCE IMAGE 



NO 
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754 



TRANSLATE CURRENT IMAGE AND ALL IMAGES 
CONNECTED TO IT RELATIVE TO THE REFERENCE IMAGE 
BASED ON THE OFFSETS OFTHE REFERENCE AND 
CURRENT IMAGE TO THE UNPOSITIONED IMAGE 



APPEND THE UNPOSITIONED IMAGE AND THE -VE OF THE 
OFFSET OF THE CURRENT IMAGE RELATIVE TO THE 
UNPOSITIONED IMAGE TO THE 
ADJACENT UST OF THE CURRENT IMAGE 
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SET 
CURRENT = 
NEXT IMAGE 
AFTER 
CURRENT 
IMAGE IN 
OVERLAP 
LIST 
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APPEND THE UNPOSITIONED IMAGE AND THE -VE 
OF THE OFFSET OF THE REFERENCE IMAGE RELATIVE 
TO THE UNPOSITIONED IMAGE TO THE ADJACENT 

LIST OF THE REFERENCE IMAGE 
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SET 
REFERENCE 
= NEXT IMAGE 

AFTER 
REFERENCE 
IMAGE IN 
OVERLAP 
LIST " 



TRANSLATE UNPOSITIONED IMAGE RELATIVE BEST_CONFIDENCE_IMAGE 
BASED ON THE OFFSET OF THE B EST_CON Fl D ENCEJ MAG E 
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APPEND IMAGES IN OVERLAP LIST AND THEIR OFFSETS 
TO THE ADJACENT LIST OF THE UNPOSITIONED IMAGE 



I 



ADD UNPOSITIONED IMAGE TO THE POSITIONED LIST 
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( GO TO 704 (FIG 7A) ) 
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DETERMINE CENTERMOST IMAGE BASED ON RELATIVE 

POSITIONS 



CREATE LIST OF CORRECTED IMAGES THAT INCLUDES 
ONLY THE CENTERMOST IMAGE 



CREATE LIST OF UNCORRECTED IMAGES THAT INCLUDES 
EVERY IMAGE EXCEPT THE CENTERMOST IMAGE 



802 



804 



806 



INITIALIZE BY SETTING: 
MAX_OVERLAP_AREA = 0 
SELECTED_WARPED_IMAGE = UNDEFINED 
SELECTED UNWARPED IMAGE = UNDEFINED 



808 



SET: 

CURRENT_WARPED = FIRST IN IMAGE IN CORRECTED LIST 
CURRENTJJNWARPED = FIRST IMAGE IN UNCORRECTED 

LIST 
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812 



COMPUTE OVERLAP AREA BETWEEN CURRENT.WARPED 
AND CURRENT UNWARPED 



814 ' 



NO 



CHECK IF 

LOVERLAP AREA > MAX_OVERLAP_AREA 
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CHANGE SELECTED IMAGES BY SETTING: 
MAX_OVERLAP_AREA = OVERLAP AREA 
SELECTED_WARPED_IMAGE = CURRENT WARPED 
SELECTED JJNWARPEDJMAGE = CURRENTJJNWARPED 
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820 
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SET 
CURRENT. 
WARPED = 
NEXT IMAGE 
IN LIST OF 
CORRECTED 
IMAGES 



CORRECT THE PERSPECTIVE OF SELECTEDJJNWARPED 
RELATIVE TO SELECTED_WARPED BASED ON THEIR RELATIVE 

POSITIONS 
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r 
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SET: 
CURRENT_ 
UNWARPED = 
NEXT IMAGE 
IN LIST OF 
UNCORRECTED 
IMAGES 
CURRENT. 
WARPED = 
FIRST IMAGE 

IN LIST OF 
CORRECTED 
IMAGES 



MOVE CURRENTJJNWARPED IMAGE FROM LIST OF 
UNCORRECTED IMMAGES TO LIST OF CORRECTED IMAGES 



*—»( DONE ^ 
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4-D coordinates 
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TRANSLATE AWAY 


BY FOCAL LENGTH 






ROTATE BY G z 
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FIG.. 10B 



13/17 



Perspective Correction Transformation 
1 . Translate outwards: 
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2. Three rotations: 
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4. Effect of focal length on Perspective: 



10 0 0 

0 10 0 

0 0 0 1// 

0 0 0 1 



146 



J 



14/17 
Perspective Correction 



Perspective Corrected Image Vertices given by: 



Pi == Pi T a Q z & v & x T b P =[*/• y,". */J- 
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But: 



w y = — — (-sine z sine x + cos^sinGyCosep 



+ y (cose z sine x + sine z sine cose x ) 

* J 
+ cose cose v 

and x/ and y/ from the perspective corrected image are given by: 



x/ = yL and y/= l /~ 
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Therefore we can write: 
Taking: 
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t = & X Q y % ft 



We can write: 



-F(t) 
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Newton's Method 



By Newton's method of numerical computation, t is an estimate 
of the values 

to* <V e z n 



then: 

166 



is a better estimate of the values. 

Where J' 1 is the matrix of partial derivatives: 
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INITIALIZE FOCAL LENGTH AND ROTATION ANGLES 


\ 


r 


COMPUTE COORDINATES OF VERTICES OF 
PERSPECTIVE DISTORTED IMAGE BASED 
ON FOCAL LENGTH AND ROTATION ANGLES 






COMPUTE ERROR BETWEEN COMPUTE 
COORDINATES OF VERTICES AND ACTUAL 
COORDINATES OF VERTICES FROM MANN METHOD 






DETERMINE JACOBIAN MATRIX 






MULTIPLY ERRORS WITH INVERSE OF JACOBIAN 
MATRIX TO DETERMINE CORRECTION TO 
ROTATION ANGLES AND FOCAL LENGTH 






UPDATE FOCAL LEIS 
ANGLES BASED 


IGTH AND ROTATION 
ON CORRECTION 
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SET PIXELS OF ALL IMAGES VISIBLE EVERYWHERE 



7206 



SET CURRENT IMAGE TO FIRST IMAGE 
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SET CURRENT IMAGE TO NEXT AFTER CURRENT IMAGE 
AND REFERENCE IMAGE TO FIRST IMAGE 



DETERMINE OUTLINE OF PANORAMIC IMAGE FORMED BY 

ALUGNING THE CURRENT AND REFERENCE IMAGES 
BASED ON THE RELATIVE POSITION OF THE SEGMENT 
CORRESPONDING TO THE CURRENT IMAGE 



I 



1212 



DETERMINE UNE DIVIDING PANORAMIC OUTLINE (I.E., 
LONGEST LINE JOINING POINTS WHERE BORDERS OF 
CURRENT IMAGE AND REFERENCE IMAGE INTERSECT) 



T 



DIVIDE PANORAMIC OUTLINE INTO TWO SECTIONS 
BASED ON LINE 



7274 

7276 
7278 



DETERMINE WHICH OF THE TWO SECTIONS HAS LESS 
OF THE CURRENT IMAGE THAT IS NOT OVERLAPPED 
BY THE REFERENCE OUTLINE 



SET CURRENT IMAGE TO NOT BE INVISIBLE IN 
THE DETERMINED SECTION 
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SET 
REFERENCE 
TO NEXT 
IMAGE 
AFTER 
REFERENCE 
IMAGE 



x 7222 

ANY MORE 
IMAGES AFTER REFERENCE IMAGE 
BUT BEFORE CURRENT 
IMAGE ? 



7220 



YES 



DETERMINE MASKING VALUE FOR EACH PIXEL OF 
CURRENT IMAGE BASED ON VISIBLE AREA OF 
IMAGE AND PROXIMITY TO DIVIDING LINES 
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ANY MORE 
IMAGES AFTER CURRENT 
IMAGE ? 

"no 
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YES 



OVERLAP IMAGES BASED ON MASKING VALUES 
TO CREATE A PANORAMIC IMAGE 



( DONE ) 
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